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APPELLANTS' BRIEF ON APPEAL UNDER 37 C.F.R. §41.37 
U.S. Application No. 09/381,839 
Atty. Docket 32860-000207/US 

II. RELATED APPEALS AND INTERFERENCES: 

There are no known appeals or interferences that will affect, be directly 
affected by, or have a bearing on the Board's decision in this Appeal. 

III. STATUS OF CLAIMS: 

Claims 4-7 are pending in the application, with claims 4 and 7 being 
written in independent form. Appellants canceled claims 1-3 via the 
September 24, 1999 Amendment. 

Claims 4-7 remain finally rejected. 

Claims 4-7 on appeal are set forth in the attached Claims Appendix. 

IV. STATUS OF AMENDMENTS: 

No amendments were requested subsequent to the final rejection in 
the January 12, 2005 Office Action. 

V. SUMMARY OF CLAIMED SUBJECT MATTER: 

Independent claims 4 and 7 are written in method formats. Both 
claims are directed to identification of objects (e.g., faces). 1 
A. Claim 4: 

With reference to the example, non-limiting embodiment depicted in 
Fig. 1 , the method defined by claim 4 may involve illuminating a digital 
micro-mirror arrangement 3 via a light source l. 2 The beam path 8 from the 
light source 1 may pass through a color filter 2 (which may include red, 
green and blue areas) to enable color image processing. 3 A color camera 6 
and the digital micro-mirror arrangement 3 may be controlled by a control 



1 Spec, p. 1, lines 3 and 4. 

2 Spec, p. 5, lines 1-3. 

3 Spec, p. 5, lines 6-10. 
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and evaluation unit ll. 4 In this way, the digital micro-mirror arrangement 3 
may apply encoded light 10 onto the object surface 7. 5 

The encoded illumination 10 may be projected onto the object surface 
7, such that three striped patterns with respectively different colors may be 
simultaneously present in a video frame. 6 By virtue of the separate and 
parallel registration of the three different color patterns, the information for 
calculating three depth planes may be acquired in a video frame. 7 As shown 
in Fig. 1 , the color camera 6 may obtain the video frame (or image of the 
object surface 7) from a direction that is different from the beam path 8. 

The control and evaluation unit 1 1 may determine a three-dimensional 
image of a topography of the object surface 7 using triangulation principles. 8 
The three-dimensional image and a two-dimensional image of the object may 
be evaluated. 9 

B. Claim 7: 

Claim 7 is substantially similar to claim 4, except that the last clause 
of claim 7 recites that the three-dimensional image is compared to pre-stored 
data. 10 

VI. GROUNDS OF REJECTION TO BE REVIEWED ON APPEAL; 

Appellants seek the Board's review of the rejection of claims 4-7 under 
35 USC §103(a) as being obvious over US 4,511,252 to Di Matteo et al. ("Di 
Matteo") in view of US 5,905,545 to Poradish et al. ("Poradish") and US 
5,410,609 to Kado et al. ("Kado"). 



4 Spec, p. 5, lines 13 and 14. 

5 Spec, p. 5, lines 14-17. 

6 Spec, p. 5, lines 19-22. 

7 Spec, p. 5, lines 22-24. 

8 Spec, p. 5, lines 29 and 30. 

9 Spec, p. 3, lines 11-13. 

10 See Spec, p. 1, lines 11-15 and p. 6, lines 9-5. 
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VII. ARGUMENTS: 

A. The Obviousness Rejection: 

L Independent Claims 4 and 7: 

Each of independent claims 4 and 7 defines a method that involves 
(among other things) determining a three-dimensional image of a topography 
of the object surface using at least "triangulation principles" As is well 
known in this art, the term "triangulatiorf refers to the process of finding a 
distance to a point by calculating the length of one side of a triangle, given 
measurements of angles and sides of the triangle formed by that point and 
two other reference points. 11 At least the "triangulation principles" feature (as 
recited in independent claims 4 and 7), in combination with the other 
features recited in independent claims 4 and 7, is not taught or suggested by 
the prior art relied upon by the Examiner. 

The Examiner relies upon the Di Matteo reference to teach most of the 
features of the present invention, inclusive of the "triangulation principles" 
feature defined by claims 4 and 7. 12 This rejection position should be 
reversed for the following reasons. 

Di Matteo discloses an arrangement for determining the geometric 
characteristics of an object. With reference to Fig. 1, the arrangement 
includes multiple projectors 26, 28, 30 and 32 that project light through 
variable masks 36 (see Fig. 3) onto a target object 20. 13 At the same time, 
cameras 40 photograph the surface 22 of the target object 20 within their 
field of view. 14 Turning to Fig. 4, the photographs 44 are scanned by a 



11 The pertinent page from the electronic dictionary Wikipedia is provided in 
the attached Evidence Appendix. 

12 January 12, 2005 Office Action, p. 3 lines 13-19 and p. 5, line 18 - p. 6, 
line 4. 

13 Di Matteo, col. 4, lines 17-26. 

14 Di Matteo, col. 5, lines 17-20. 



4 



APPELLANTS' BRIEF ON APPEAL UNDER 37 C.F.R. §41.37 
U.S. Application No. 09/381,839 
Atty. Docket 32860-000207/US 

scanner 46, and the scanned information is inserted into a computer 48. 15 
The surface 22 of the target object 20 may be reconstructed from information 
stored in the computer 48. 16 Di Matteo explains the manner in which the 
coordinates of points on the surface 22 may be determined by correlating the 
points to a reference surface (discussed in more detail below). However, the 
reference does not provide any disclosure that is pertinent to the claimed 
"triangulation principles" feature. In fact, the reference does not even 
mention the term triangulation. 

The Examiner cites several portions of Di Matteo as allegedly teaching 
a method that involves determining a three-dimensional image of a 
topography of the object surface using triangulation principles. However, 
the heavy reliance upon the cited portions of the reference is misplaced. 
Each of the cited portions of Di Matteo is discussed separately below. 

Column 7, lines 56+: This straightforward portion of Di Matteo 
indicates that the spatial position of a point on the object surface may be 
determined using an interpolation technique. The interpolation technique is 
described with reference to Fig. 8. Here, a photograph of a band of the 
object surface 22 includes a point P. The image of that band on the 
photograph appears as an outline 60. A photograph 58 (see Fig. 7) of a 
reference surface is superimposed onto the photograph containing the 
outline 60. The spatial position of the point P may then be located by 
"interpolation" with respect to the neighboring points of intersection 58a and 
58b. 17 Points 58d and 58c are used for "interpolating" to point P from points 
58a and 58b, respectively. 18 

As is well-known in this art, interpolation is a method of constructing 
new data points (e.g., the point P) from a discreet set of known data points 



15 Di Matteo, col. 5, lines 53-57. 

16 Di Matteo, col. 6, lines 23-27. 

17 Di Matteo, col. 7, lines 62-65. 

18 Di Matteo, col. 8, lines 1 and 2 
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(e.g., 58a, 58b, 58c and 58d). 19 Di Matteo 's interpolation technique is simply 
not pertinent to determining a three-dimensional image of a topography of 
an object surface using at least "triangulation principles" as recited in 
independent claims 4 and 7. 

Column 11, lines 56-68: This portion of the reference merely indicates 
that the coordinates of a point on a three-dimensional surface may be 
located by determining the Z coordinate using masks 36 (see Fig. 3), and by 
determining the X-Y coordinates by scanning a photograph 44 (see Fig. 2) of 
the surface and superimposing a reticle 82 (see Fig. 12) onto the photograph 
44. 

This disclosure is not at all pertinent to " triangulation principles" The 
Examiner's assertions to the contrary are simply incorrect. 

Column 14, lines 57-68 and column 15, lines 1-12: This portion of Di 
Matteo explains an embodiment (depicted in Fig. 18) in which the location of 
a point on a surface may be determined from "computations involving the 
intersection of a line and a plane" 20 Here, if a point on a surface is 
photographed and its image appears on the film 106 (at point P3), the 
surface point of interest must lie somewhere along the line 110 (extending 
between the lens node 108 and the point P2 on the reference surface 52). 21 
Every known point on the reference surface 52 will define a known line 
between itself and the lens node 108 (e.g., line 110) and will further define a 
point on the film (e.g., P3). 22 Thus, a picture of the reference surface 52 may 
be used as an overlay to the pictures of an unknown surface to "transform 
positions" on the film to lines through the lens node that are geometrically 
exact. 23 In practice, the spatial coordinates may be assigned to a point P of 

19 The pertinent page from the electronic dictionary Wikipedia is provided in 
the attached Evidence Appendix. 

20 Di Matteo, col. 13, lines 41-44. 

21 Di Matteo, col. 14, lines 50-53. 

22 Di Matteo, col. 14, lines 53-57. 

23 Di Matteo, col. 14, lines 57-60. 
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interest, since that point may be solved for as the intersection of a plane and 
the line obtained from the position of the image and that point on the film. 24 

Appellants contend that such teachings are simply not pertinent to the 
"triangulation principles" feature recited in independent claims 4 and 7. The 
Examiner assertions to the contrary appear to based upon a speculation 
and /or a misunderstanding of the reference. 

Turning to the next point, the Examiner makes assertions concerning 
Fig. 8 of Di Matteo in an attempt to bolster the rejection position. Some of 
the assertions warrant further comment as follows. First, the Examiner 
points out that Di Matteo's entire disclosure is devoted to ascertaining the 3- 
D geometrical dimensions of objects and relies on triangulation principles 
such as shown in Fig. 8. 25 However, as discussed in detail above, Fig. 8 of 
Di Matteo illustrates how the spatial position of a point on the object surface 
may be determined using an interpolation technique (which is practically 
and conceptually different than triangulation principles). 26 The allegation 
that Di Matteo's "entire disclosure" is devoted to ascertaining geometrical 
dimensions does not somehow change or detract from the straightforward 
and express disclosure directed to Fig. 8 of the reference. 

Second, Appellants agree with the Examiner to the extent that 
triangulation techniques may involve (among other things) using 
trigonometric principles to determine the coordinates of a point in space, 
where the point may be the vertex of a triangle having two other vertices with 
known coordinates. 27 However, the Examiner's contention that Fig. 8 of Di 
Matteo fairly teaches a triangulation technique is without merit for the 
reasons discussed above (i.e., Fig. 8 is directed to an interpolation technique, 
but not a triangulation technique). 



24 Di Matteo, col. 15, lines 1-12. 

25 June 14, 2005 Advisory Action, Item 11. 

26 Di Matteo, col. 7, lines 56+. 

27 June 14, 2005 Advisory Action, Item 11. 
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Third, in an effort to support the alleged triangulation theory, the 
Examiner contends that in Fig. 8 of Di Matteo, the location of point P is 
ascertained by forming a triangle composed of two other known points. 28 
This simply not understood because Fig. 8 does not illustrate a triangle. 
Instead, the drawing contains an oval shape (formed by intersections 58), an 
arcuate outline 60, and two straight lines that intersect at point P. 
ii. Conclusion: 

As demonstrated above, the Di Matteo does not teach or suggest the 
features upon which the Examiner relies to reject the claims. Further, the 
secondary references to Poradish and Kado are not believed to make up for 
the deficiencies of Di Matteo noted above. Accordingly, even if combined in 
the manner suggested by the Examiner, the prior art would still not meet 
each and every feature of the invention defined by independent claims 4 and 
7. 

The Commissioner is authorized in this, concurrent, and future 
replies, to charge payment or credit any overpayment to Deposit Account No. 
08-0750 for any additional fees required under 37 C.F.R. § 1.16 or under 37 
C.F.R. § 1.17; particularly, extension of time fees. 



Respectfully submitted, 



HARNESS, DICKEY, & PIERCE, P.L.C. 



By: 




Ray Heflin^ Reg. No. 41,060 
P.O. Box 8910 
Reston, Virginia 20195 
(703) 668-8000 



DJD/HRH 



28 June 14, 2005 Advisory Action, Item 11. 
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CLAIMS APPENDIX 

Claims 4-7 on Appeal: 

4. A method for identification of an object having an object surface, 
said method comprising: 

illuminating a digital micro-mirror arrangement via a light source; 

successively projecting a number of encoded illumination patterns by 
driving said digital micro-mirror arrangement to sequentially illuminate said 
object surface, with the digital micro- mirror arrangement being sequentially 
illuminated with at least three colors in a beam path through a variable color 
filter onto said object surface for identification of at least three depth planes 
of said object in a single image; 

registering said image of said object with a color camera from a 
direction different from said beam path; 

determining a three-dimensional image of a topography of said object 
surface from said registration in a control and evaluation unit, the 
determining including the use of at least triangulation principles; and 

evaluating the three-dimensional image and a two-dimensional image 
of said object. 

5. The method according to claim 4, wherein said encoded 
illumination patterns comprise a stripe pattern having successively varied 
periodicity. 

6. The method according to claim 4, wherein said method is used 
for face identification. 

7. A method for identification of an object having an object surface, 
said method comprising: 
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illuminating a digital micro-mirror arrangement via a light source; 

successively projecting a number of encoded illumination patterns by 
driving said digital micro-mirror arrangement to sequentially illuminate said 
object surface, with the digital micro- mirror arrangement being sequentially 
illuminated with at least three colors in a beam path through a variable color 
filter onto said object surface for identification of at least three depth planes 
of said object in a single image; 

registering said image of said object with a color camera from a 
direction different from said beam path; 

determining a three-dimensional image of a topography of said object 
surface from said registration in a control and evaluation unit, the 
determining including the use of at least triangulation principles; and 

comparing the three-dimensional image to pre-stored data. 
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EVIDENCE APPENDIX 

1 . One page from the electronic dictionary Wikipedia for the term 
"triangulation." 

2. Five pages from the electronic dictionary Wikipedia for the term 
"interpolation." 
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Triangulation - Wikipedia, the free encyclopedia 



Page 1 of 1 



Triangulation 

From Wikipedia, the free encyclopedia. 

This article is about measurement by the use of triangles: for other usages of the term "triangulation", see 
triangulation (disambiguation). 

In trigonometry and elementary geometry, 
triangulation is the process of finding a distance to a 
point by calculating the length of one side of a triangle, 
given measurements of angles and sides of the triangle 
formed by that point and two other reference points. 

Some identities often used (valid only in flat or 
euclidean geometry): 



■ The sum of the angles of a triangle is n rad or 
180 degrees. 

■ The law of sines 

■ The law of cosines 

■ The Pythagorean theorem 

Triangulation is used for many purposes, including surveying, navigation, astrometry, binocular vision and gun 
direction of weapons. 

Many of these surveying problems involve the solution of large meshes of triangles, with hundreds or even 
thousands of observations. Complex triangulation problems involving real-world observations with errors require 
the solution of large systems of simultaneous equations to generate solutions. 

Famous uses of triangulation have included the retriangulation of Great Britain. 

See also 

■ Parallax 

■ Trilateration, wherein a point is calculated given its distances from other known points 
Retrieved from ,! http://en.wikipedia.org/wiki/Triangulation M 

Categories: Elementary geometry | Euclidean geometry | Surveying | Angle 



■ This page was last modified 04:27, 3 October 2005. 

■ All text is available under the terms of the GNU Free 
Documentation License (see Copyrights for details). 
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Triangulation can be used to find the distance from the 
shore to the ship. The observer at a measures the angle 
between the shore and the ship, and the observer at ft does 
likewise. If the length / is known, then the law of sines can 
be applied to find the distance d. 



http://en.wikipedia.org/wiki/Triangulation 
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Interpolation - Wikipedia, the free encyclopedia 

Interpolation 



Page 1 of 5 



From Wikipedia, the free encyclopedia. 

This article is about interpolation in mathematics. See also interpolation (music) and interpolation 
(manuscripts). 

In the mathematical subfield of numerical analysis, interpolation is a method of constructing new data points 
from a discrete set of known data points. 

In engineering and science one often has a number of data points, as obtained by sampling or some experiment, 
and tries to construct a function which closely fits those data points. This is called curve fitting. Interpolation is a 
specific case of curve fitting, in which the function must go exactly through the data points. 

A different problem which is closely related to interpolation is the approximation of a complicated function by a 
simple function. Suppose we know the function but it is too complex to evaluate efficiently. Then we could pick a 
few known data points from the complicated function and try to interpolate those data points to construct a 
simpler function. Of course when using the simple function to calculate new data points we usually do not receive 
the same result as when using the original function, but depending on the problem domain and the interpolation 
method used the gain in simplicity might offset the error. 

It should be mentioned that there is also another very different kind of interpolation in mathematics, namely the 
"interpolation of operators". The classical results about interpolation of operators are the Riesz-Thorin theorem 
and the Marcinkiewicz theorem and there are many other subsequent results. 
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Definition 

Given a sequence of n distinct numbers x k called nodes and for each x k a second number^, we are looking for a 
function / so that 

/(**) = Vk , fc= 

A pair x^y k is called a data point and /is called the interpolant for the data points. 
When the y k are given by a known function we sometimes write f k . 

Example 
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For example, suppose we have a table like this, which gives some values of an unknown function / 



x 
0 
1 
2 
3 
4 
5 
6 



Ax) 

0 

0.8415 
0.9093 
0.1411 
-0.7568 
-0.9589 
-0.2794 



What value does the function have at, say, x = 2.5? Interpolation 
answers questions like this. 

There are many different interpolation methods, some of which 
are described below. Some of the things to take into account 
when choosing an appropriate algorithm are: How accurate is the 
method? How expensive is it? How smooth is the interpolant? 
How many data points are needed? 



Linear interpolation 



o 



4 



6 
* 



Plot of the data points as given in the table. 



Main article: Linear interpolation 

One of the simplest methods is linear interpolation (sometimes 
known as lerp). Consider the above example of determining /(2. 5). 
Since 2.5 is midway between 2 and 3, it is reasonable to takey(2.5) 
midway between /2) = 0.9093 and/3) = 0.141 1, which yields 
0.5252. 

Generally, linear interpolation takes two data points, say (x a ,y a ) 
and (x b y b ), and the interpolant is given by 

* * \ X X fo X Xq 
f( x ) = Z — Va ~ Z —Vb 



Xq Xjy 



X Q Xfo 




This formula can be interpreted as a weighted mean. 

Linear interpolation is quick and easy, but it is not very precise. 
Another disadvantage is that the interpolant is not differentiable at 
the point x^ 

The following error estimate shows that linear interpolation is not very precise. Denote the function which we 
want to interpolate by g, and suppose that x lies between x Q and x b and that g is twice continuously differentiable. 
Then the linear interpolation error is 



\f(x) - g(x)\ < C(x b - x a ) 2 where C = - max g"(y). 
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In words, the error is proportional to the square of the distance between the data points. The error of some other 
methods, including polynomial interpolation and spline interpolation (described below), is proportional to higher 
powers of the distance between the data points. These methods also produce smoother interpolants. 

Polynomial interpolation 

Main article: Polynomial interpolation 

Polynomial interpolation is a generalization of linear interpolation. 
Note that the linear interpolant is a linear function. We now replace 1 
this interpolant by a polynomial of higher degree. 

Consider again the problem given above. The following sixth 
degree polynomial goes through all the seven points: 

fix) = - 0.0001521* 6 - 0.003 130x 5 + 0.07321* 4 - 0.3577* 3 q 
+ 0.2255* 2 + 0.9038*. 

Substituting x = 2.5, we find that/2.5) = 0.5965. 

Generally, if we have n data points, there is exactly one polynomial 
of degree n-\ going through all the data points. The interpolation 
error is proportional to the distance between the data points to the -1 
power n. Furthermore, the interpolant is a polynomial and thus 
infinitely differentiable. So, we see that polynomial interpolation solves all the problems of linear interpolation. 

However, polynomial interpolation also has some disadvantages. Calculating the interpolating polynomial is very 
'expensive' (in relative terms of computer calculation time). Furthermore, polynomial interpolation may not be so 
exact after all, especially at the end points (see Runge's phenomenon). These disadvantages can be avoided by 
using spline interpolation. 

Spline interpolation 

Main article: spline interpolation 

Remember that linear interpolation uses a linear function for each of intervals Spline interpolation 

uses low-degree polynomials in each of the intervals, and chooses the polynomial pieces such that they fit 
smoothly together. The resulting function is called a spline. 

For instance, the natural cubic spline is piecewise cubic and twice continuously differentiable. Furthermore, its 
second derivative is zero at the end points. The natural cubic spline interpolating the points in the table above is 
given by 
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0 



/(*) = < 



-0.l522z 3 +0.9937*, 

-0.01258x 3 - 0.4189x 2 + 1.4126z - 0.1396, 
0.1403z 3 - 1.3359x 2 + 3.2467x - 1.3623, 
0.1579T 3 - 1.4945* 2 + 3.7225:c - 1.8381, 

0.05375t 3 - 0.2450x 2 - 1.2756r + 4.8259, 



if x £ [0,1], 
if x E [1,2], 
if x E [2,3], 
if x E [3,4], 
if x E [4,5], 



k -0.1871 x 2 + 3.3673J 2 - 19.3370* + 34.9282, if x E [5, 6] 



Like polynomial interpolation, spline interpolation incurs a smaller error than linear interpolation and the 
interpolant is smoother. However, the interpolant is easier to evaluate than the high-degree polynomials used in 
polynomial interpolation. It also does not suffer from Runge's phenomenon. 

Other forms of interpolation 

Other forms of interpolation can be constructed by picking a different class of interpolants. For instance, rational 
interpolation is interpolation by rational functions, and trigonometric interpolation is interpolation by 
trigonometric polynomials. The discrete Fourier transform is a special case of trigonometric interpolation. 
Another possibility is to use wavelets. 

The Nyquist-Shannon interpolation formula can be used if the number of data points is infinite. 

Multivariate interpolation is the interpolation of functions of more than one variable. Methods include bilinear 
interpolation and bicubic interpolation in two dimensions, and trilinear interpolation in three dimensions. 

Sometimes, we know not only the value of the function that we want to interpolate, at some points, but also its 
derivative. This leads to Hermite interpolation problems. 

Related concepts 

The term extrapolation is used if we want to find the value of/at a point jc which is outside of the points x k at 
which /is given. 



In curve fitting problems, the constraint that the interpolant has to go exactly through the data points is relaxed. 
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We only require that it approaches the data points as closely as possible. This requires parameterizing the 
> * potential interpolants and having some way of measuring the error. In the simplest case this leads to least squares 
approximation. 

* Approximation theory studies how to find the best approximation to a given function by another function from 
some predetermined class, and how good this approximation is. This clearly yields a bound on how well the 
interpolant can approximate the unknown function. 
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